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Maximum  forces  and  forces  at  general  yield  measured  on  impact  reference 
materials  in  round  robin  testing  are  reported.  These  dynamic  results  are 
compared  with  static  force  calibration  of  instrumented  strikers.  One  machine  in 
the  round  robin  was  identified  as  an  outlier  by  the  dynamic  force  measurement 
results,  indicating  that  dynamic  testing  may  be  a useful  approach  to  check  the 
performance  of  the  instrumented  machine  and  measurement  system.  For  the 
maximum  forces,  repeatability  (95  %)  and  reproducibility  limits  of  0.45  kN  and 
2.16  kN,  respectively,  were  determined  for  the  high  energy  specimens. 

Key  Words:  Charpy  impact;  dynamic  force  measurement;  instrumented  impact 
testing 

1.  Summary 

The  maximum  forces  and  the  forces  at  general  yield  measured  by  the  machines  in  this  round 
robin  are  in  good  agreement.  This  general  result  shows  that  the  static  force  calibration  of 
instrumented  strikers  is  quite  robust,  and  that  the  various  striker  designs  evaluated  here 
performed  in  a predictable  manner.  One  machine  in  the  round  robin  was  identified  as  an  outlier 
by  the  dynamic  force  measurement  results,  indicating  that  dynamic  testing  may  be  a useful 
approach  to  check  the  performance  of  the  instrumented  machine  and  measurement  system. 

It  is  not  clear  if  differences  observed  between  strikers  with  2 mm  and  8 mm  radii  are  of  practical 
significance.  More  data  are  needed  to  fully  evaluate  this  variable. 

The  certified  value  determined  for  the  maximum  force  of  the  low  energy  (LL-103)  specimens  is 
32.97  ±0.75  kN  (±2.3  %),  with  an  expanded  uncertainty  of  1.84  kN  (5.6  %).  The  specimens 
have  a 95  % uncertainty  interval  of  ±6  %. 
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The  certified  value  determined  for  the  maximum  force  of  the  high  energy  (HH-103)  specimens  is 
24.06  ±0.28  kN  (±1.2  %),  with  an  expanded  uncertainty  of  0.70  kN  (2.9  %).  The  specimens 
have  a 95  % uncertainty  interval  of  ±3  %. 

The  precision  of  the  maximum  force  measured  for  the  HH-103  specimens  is  higher  than  that 
measured  for  the  LL-103  measurements.  The  95  % repeatability  and  reproducibility  limits  for  the 
HH-103  measurements  were  0.45  kN  and  2.16  kN,  respectively  (compared  with  1.90  kN  and 
5.96  kN  for  LL-103). 

The  mean  general  yield  value  for  the  HH-103  specimens  was  19.60  kN.  The  95  % repeatability 
and  reproducibility  limits  were  2.30  kN  and  3.59  kN,  respectively.  Forces  at  general  yield  are  not 
reported  for  LL-103  specimens,  since  general  yield  cannot  be  unambiguously  defined  for  fully 
brittle  tests. 

The  low  variation  associated  with  the  HH-103  specimen  makes  it  suitable  for  use  as  a material 
for  dynamic  force  verification. 

2.  Background 

Instrumented  strikers  for  impact  machines  are  calibrated  with  statically  applied  loads,  traceable 
to  certified  load  cells.  This  static  calibration  method  has  been  found  to  work  quite  well. 
However,  in  some  cases  it  may  be  convenient  to  check  the  performance  of  the  machine,  striker, 
and  force  measurement  system  using  a verification  specimen.  Currently  NIST  does  not  offer  a 
certified  reference  material  that  can  be  used  to  verify  the  performance  of  an  instrumented  impact 
machine. 

3.  Test  Plan 

3.1.  Objective 

The  round  robin  was  conducted  primarily  to  evaluate  the  suitability  of  using  Charpy  verification 
materials  as  dynamic  force  verification  materials,  and  to  establish  certified  reference  values  for 
the  maximum  force  measured  for  these  two  steels  in  an  instrumented  impact  test.  These  steels 
are  expected  to  provide  dynamic  force  verification  at  two  levels  of  maximum  force  (around  25 
and  30  kN).  In  addition,  the  precision  of  the  data  is  evaluated  in  terms  of  repeatability  and 
reproducibility  according  to  ASTM  E 691-05. 

3.2.  Design 

Specimens  from  batches  of  high  (HH-103)  and  low  (LL-103)  energy  level  Charpy  V-notch 
verification  specimens  are  tested  on  instrumented  Charpy  pendulum  impact  machines.  The 
specimens  have  already  been  certified  by  NIST  for  absorbed  energy  using  conventional  Charpy 
pendulum  impact  machines.  The  batch  sizes  for  these  high  and  low  energy  specimens  are  such 
that,  following  this  round  robin,  about  800  to  900  specimens  can  be  certified  as  force  verification 
specimens  and  some  reserve  specimens  can  be  held  for  future  stability  testing,  etc. 
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3.3.  Reporting 

This  summary  report  on  the  testing  will  be  distributed  to  the  participants  and  cited  on  certificates 
developed  for  the  specimens.  The  summary  report  is  public  information,  and  participants  are 
encouraged  to  write  journal  articles  based  on  the  results  of  the  testing. 

3.4.  Testing  Details 

o Materials:  Two  steels  (LL-103  low  energy  and  HH-103  high  energy) 
o Specimens:  Standard  size  ASTM  E 23  Charpy  V-notch  specimens  ( 1 0 mm  x 1 0 mm  x 55 
mm) 

o Anvil  Geometry:  The  ASTM  E 23  or  ISO  148  anvil  geometry 

o Striker  Geometry:  Testing  on  either  2 mm  (ISO  148)  or  8 mm  (ISO  148  or  ASTM  E 23) 
radius  striker  geometries" 

o Machine  Type:  Testing  on  instrumented  pendulum  impact  machines 
o Test  Procedure:  Testing  conducted  in  accordance  with  ASTM  E 23  and  ASTM  work  item 
WK20198  (Method  for  Instrumented  Impact  Tests  of  Metallic  Materials)  or  ISO  148-1  and 
ISO  14556 

o Test  Matrix:  Ten  specimens  at  each  energy  level  tested  for  each  striker  geometry  used 
o Test  Temperature:  Room  temperature 

o Test  Time:  Test  the  specimens  within  3 months  of  receiving  them 


Table  1.  Materials  and  machines. 


Materia 

1 

Machine 

type 

Striker 

geometry 

(mm) 

Number  of 
specimens 

Steel  1 

Pendulum 

8 

10 

LL-103 

2 

10 

Steel  2 

Pendulum 

8 

10 

HH-103 

2 

10 

3.5.  Participants 


Table  2.  Participants. 


Contact 

Laboratory 

Wolfgang  Bohme 

Fraunhofer  Institute  for  Mechanics  of  Materials, 
Freiburg  (Germany) 

Harald  Diem 

MPI  University  of  Stuttgart  (Germany) 

Enrico  Lucon 

SCKCEN,  Institute  of  Nuclear  Materials,  Mol 
(Belgium) 

Chris  McCowan 

National  Institute  of  Standards  and  Technology, 
Boulder  CO  (USA) 

Vaclav  Mentl 

SKODA  Research.  Plzen  (Czech  Republic) 

Hans-Werner  Viehrig 

Forschungszentrum  Dresden,  Rossendorf 
(Gennany) 
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4.  Results  and  Discussion 


4.1.  Maximum  Force 

A total  of  1 0 specimens  were  tested  on  each  of  8 Charpy  machines  for  the  force  verification 
round  robin.  The  data  were  evaluated  from  averaged  force-signals  according  to  ISO  14556  or 
ASTM  WK20198.  The  raw  data  from  the  round  robin  (maximum  forces)  are  shown  in  Appendix 
A.  Two  sets  of  ten  verification  specimens  were  tested  with  machine  #8  (identified  as  8a  and  8b 
in  Appendix  A).  The  measurements  for  machine  #8  were  combined  since  there  is  no  statistical 
difference  between  the  averages  of  the  two  sets  and  no  apparent  trend  in  the  data.  Machine  #2 
and  machine  #8  use  an  8 mm  striker,  the  remaining  machines  all  use  a 2 mm  striker.  Figures  1 
and  2 display  the  maximum  force  for  low-energy  and  high-energy  specimens,  respectively. 

The  data  appear  to  be  fairly  consistent  among  machines,  with  the  exception  of  machine  #4, 
which  has  test  results  that  are  much  lower  than  the  rest  of  the  data  for  both  low  and  high 
energies.  Since  machine  #4  produces  consistently  low  values,  we  exclude  it  from  further 
analyses. 

4.1.1.  Striker  Radius 

Figures  3 and  4 display  the  force  data  versus  striker  radius  for  low  and  high  energies, 
respectively. 

Figures  3 and  4 indicate  that  striker  radius  may  have  some  effect  on  maximum  force.  We 
performed  a /-test  to  determine  if  the  mean  of  the  data  from  machines  having  an  8 mm  striker  is 
statistically  different  from  the  mean  of  data  from  machines  with  2 mm  strikers  for  each  energy 
level.  Based  on  the  /-test  (using  the  Satterthwaite  method  for  unequal  variances  [1]),  the  8 mm 
striker  mean  is  statistically  different  from  the  2 mm  striker  mean  for  both  low  and  high  energies 
(p  < 0.0001).  Figure  5 displays  the  means  of  each  group  along  with  error  bars  (twice  the 
standard  error  of  the  mean,  or  2s/  4~n  ). 

The  error  bars  in  Figure  5 do  not  overlap  for  either  low  or  high  energy,  also  indicating  that  there 
is  a significant  difference  between  2 mm  and  8 mm  striker  means.  In  addition,  the  figure  shows 
that  the  8 mm  striker  means  are  higher  than  the  2 mm  striker  means. 

A /-test  using  combined  machine  data  may  not  be  the  best  way  to  examine  striker  differences 
because  of  the  large  sample  sizes  in  each  group.  The  /-test  will  always  find  a difference  between 
groups  if  the  sample  sizes  are  large  enough  since  the  uncertainty  of  the  mean  decreases  as  the 
sample  size  increases.  An  alternative  to  the  /-test  is  to  determine  if  the  two  8 mm  striker 
machines  have  large  influence  on  the  consensus  value  [2].  If  both  machines  with  8 mm  strikers 
are  highly  influential,  then  there  is  evidence  that  there  are  striker  differences.  Table  3 lists  the 
“hat”  value,  standardized  residual,  and  Cook’s  D for  each  machine  and  energy  level. 
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Maximum  Force  (kN)  Maximum  Force  (kN) 


Figure  1.  Low-energy  maximum  force  for  eight  machines. 


Figure  2.  High-energy  maximum  force  for  eight  machines. 
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Maximum  Force  (kN)  Maximum  Force  (kN) 


Figure  3.  Maximum  force  versus  striker  radius  for  low-energy  specimens. 
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Energy  Level/Striker  Radius  (mm) 

Figure  5.  Maximum  force  means  and  associated  error  bars  (twice  the  standard  error  of  the  mean)  for  both 
low  and  high  energy  striker  means. 

Table  3.  Hat  value,  standardized  residual,  and  Cook’s  D for  each  machine  and  energy  level. 


Machine 

Low  Energy 

High  Energ; 

V 

Hat 

Value 

Std  Residual 

Cook’s  D 

Hat 

Value 

Std 

Residual 

Cook’s 

D 

1 

0.14 

0.1 

0.001 

0.14 

-1.1 

0.185 

2 

0.14 

1.8 

0.501 

0.14 

1.4 

0.324 

3 

0.14 

0.8 

0.011 

0.14 

-0.6 

0.062 

5 

0.14 

-0.5 

0.047 

0.14 

1.2 

0.220 

6 

0.14 

-0.7 

0.078 

0.14 

-0.0 

0.000 

7 

0.14 

-1.5 

0.372 

0.14 

-1.4 

0.329 

8 

0.14 

0.0 

0.000 

0.14 

0.5 

0.048 

A machine  is  considered  influential  if  the  hat  value  is  greater  than  0.29,  or  if  the  standardized 
residual  is  larger  than  the  absolute  value  of  2,  or  if  Cook’s  D is  larger  than  0.445.  None  of  the 
quantities  listed  in  Table  3 exceed  the  guidelines  for  detecting  influential  machines,  indicating 
that  it  may  not  be  necessary  to  calculate  a separate  consensus  value  for  each  striker  type. 

Although  means  for  the  two  striker  radii  are  statistically  different  for  both  energy  levels  based  on 
a 7-test,  there  is  no  evidence  of  striker  differences  based  on  an  analysis  of  influence  quantities. 
Thus,  it  is  not  clear  if  striker  differences  are  of  practical  significance.  Additional  data  from 
machines  with  8 mm  strikers  would  be  helpful  in  deciphering  the  striker  effect.  For  now,  we  will 
proceed  with  computing  the  certified  reference  value  as  if  the  striker  radius  has  no  effect. 
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4.1.2.  Certified  Reference  Value 


The  certified  reference  value  was  determined  by  use  of  the  Paule-Mandel  method  for  computing 
a consensus  value  [3],  The  consensus  value  depends  on  the  assumption  that  all  Charpy  machines 
in  the  study  are  “good”  and  that  no  single  machine  is  thought  to  produce  better  results  than  the 
others.  The  consensus  value  is  a weighted  mean  in  which  the  weights  account  for  both 
within-machine  and  between-machine  variation.  The  certified  reference  value  (consensus 
value)  Y is  computed  from 


Y = 


(1) 


where  k is  the  number  of  machines,  coi  is  the  weight  for  the  /th  machine,  and  Yt  is  the  average  of 
the  measurements  for  the  /'th  machine.  The  standard  uncertainty  of  the  certified  reference  value  is 


u(Y)  = 


(2) 


The  estimated  weight  for  the  /th  machine  is 


co, 


S^sl 

n: 


(3) 


where  s~  is  the  usual  sample  variance  of  the  /th  machine,  ni  is  the  number  of  test  results  for  the 
1th  machine,  and  s l is  the  estimated  variance  between  machines.  The  between-machine  variance 


estimate  is  determined  by  an  iterative  procedure  [3].  We  used  the  “consensus  means”  command 
in  a statistical  analysis  package  called  DATAPLOT  [4]  to  compute  the  between-machine 
variance.  Table  4 lists  certified  reference  values,  associated  uncertainties,  coverage  factors,  and 
expanded  uncertainties  corresponding  to  95  % uncertainty  intervals  for  low  and  high  energy 
specimens. 
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1 2 3 4 5 6 7 8 

Machine 

Striker  Radius,  mm  000  2 ***  8 


Figure  6.  Low-energy  maximum  force  for  final  set  of  machines  with  certified  reference  value  (middle 
line).  The  top  and  bottom  horizontal  lines  represent  the  95  % uncertainty  interval  for  the  certified  value. 


Striker  Radius,  mm  000  2 8 

Figure  7.  High-energy  maximum  force  for  final  set  of  machines  with  certified  reference  value  (middle 
line).  The  top  and  bottom  lines  represent  the  95  % uncertainty  interval  for  the  certified  reference  value. 
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Table  4.  Certified  reference  values,  standard  uncertainty,  coverage  factor,  and  expanded  uncertainty. 


Energy  level 

Certified 
reference  value 
(kN) 

Standard 
uncertainty  (kN) 

Coverage  factor, 
k 

Expanded 
uncertainty  (kN) 

Low  33.00  0.76  2.447  1.86 

High 24.06 028 2.447 070 


The  coverage  factor  for  both  low  and  high  energy  levels  is  based  on  a 7-table  value  for  7-1=6 
degrees  of  freedom  and  a 95  % two-sided  uncertainty  interval.  The  data,  certified  reference 
value,  and  95  % uncertainty  bounds  for  low  and  high  energy  data  are  shown  in  Figures  6 and  7. 

We  also  computed  the  reference  value  for  just  the  machines  having  2 mm  strikers  to  compare 
with  the  reference  value  based  on  all  machines.  The  reference  values  based  on  just  the  machines 
having  2 mm  strikers  were  lower  by  2. 1 % and  1.1%  for  low  and  high  energy,  respectively. 
Thus,  the  reference  value  is  not  substantially  altered  by  including  machines  with  8 mm  strikers. 

4.1.3.  Repeatability  and  Reproducibility 

The  data  from  this  round  robin  are  also  useful  in  estimating  the  precision  of  maximum  force 
measurements.  The  precision  is  evaluated  according  to  the  terms  of  repeatability  and 
reproducibility  defined  in  ASTM  E 691-05.  The  procedures  in  E 691  rely  on  the  assumption  that 
an  equal  number  of  measurements  are  taken  for  each  machine.  Thus,  the  second  set  of  NIST 
measurements  was  not  included  in  the  analysis.  Although  there  are  only  nine  measurements  for 
machine  #3  for  the  high  energy  material,  this  small  deviation  in  sample  size  should  not 
significantly  influence  the  results  of  the  analysis.  The  raw  data  for  the  eight  machines  are 
displayed  in  Figure  1 for  low-energy  specimens  and  in  Figure  2 for  high-energy  specimens. 

The  plots  of  the  raw  data  indicate  that  the  measurements  for  machine  #4  are  not  consistent  with 
the  remaining  data.  Table  5 lists  summary  statistics  for  each  machine  and  material.  The 
deviation  is  the  difference  between  the  individual  machine  mean  and  the  grand  mean  for  that 
material.  The  low-energy  grand  mean  is  3 1 .75  kN  and  the  high-energy  grand  mean  is  23.38  kN. 
Consistency  statistics  for  each  machine  are  listed  in  Table  6.  The  “k”  consistency  statistic 
represents  the  consistency  of  variation  within  a laboratory,  while  the  “h”  consistency  statistic 
summarizes  the  consistency  between  laboratories. 

The  critical  values  for  h and  k were  taken  from  Table  5 in  E 691-05  for  p = 8 and  n = 10 . An  h 
consistency  statistic  is  considered  to  be  significant  if  its  absolute  value  is  larger  than  2.15.  A k 
consistency  statistic  is  considered  significant  if  it  is  larger  than  1.55.  Plots  of  the  consistency 
statistics  and  the  associated  critical  values  are  shown  in  Figures  8 and  9. 

Figure  8 shows  three  machines  with  k values  larger  than  the  critical  value,  indicating  that  the 
within-machine  variation  is  large  compared  to  the  other  machines.  Machines  #2  and  #3  have 
large  variation  for  the  low-energy  material,  while  machine  #6  has  large  variation  for  the  high- 
energy  material.  Since  no  machine  has  significant  k values  for  both  materials,  there  is  no  reason 
to  remove  machines  from  the  study  based  on  the  k statistics. 
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Table  5.  Machine  summary  statistics. 


Machine 

Low  energy  (LL-103) 

High  energy  (HH-103) 

Mean 

(kN) 

Standard 

deviation 

(kN) 

Deviation 

(kN) 

Mean 

(kN) 

Standard 

deviation 

(kN) 

Deviation 

(kN) 

1 

33.15 

0.17 

1.40 

23.33 

0.06 

-0.05 

2 

36.47 

1.19 

4.72 

25.03 

0.12 

1.65 

3 

34.56 

0.99 

2.81 

23.64 

0.13 

0.26 

4 

22.90 

0.20 

-8.85 

18.60 

0.15 

-4.78 

5 

32.02 

0.28 

0.27 

24.87 

0.22 

1.49 

6 

31.72 

0.61 

-0.03 

24.06 

0.29 

0.68 

7 

30.24 

0.20 

-1.51 

23.09 

0.10 

-0.29 

8 

32.93 

0.55 

1.18 

24.42 

0.11 

1.04 

Table  6.  Consistency  statistics  for  eight  Charpy  machines. 


Machine 

Low  energy  (LL-103) 

High  energy  (HH-103) 

h 

k 

h 

k 

1 

0.34766 

0.26354 

-0.0231 

0.34751 

2 

1.16914 

1.86445 

0.80543 

0.71004 

3 

0.69552 

1.54991 

0.12535 

0.80409 

4 

-2.19078 

0.31448 

-2.32847 

0.91881 

5 

0.06716 

0.43727 

0.72555 

1.36436 

6 

-0.00712 

0.96304 

0.33101 

1.79579 

7 

-0.37329 

0.3097 

-0.14263 

0.61345 

8 

0.29171 

0.85946 

0.50685 

0.64934 

Figure  9 shows  that  the  h consistency  statistics  are  significant  for  machine  #4  for  both  materials, 
indicating  that  the  measurements  for  this  machine  are  significantly  different  from  those  of  the 
remaining  machines  relative  to  the  between-machine  variation.  We  will  remove  machine  #4 
from  the  study  since  the  measurements  for  both  low  and  high  energy  materials  were  significantly 
lower  than  the  rest  of  the  measurements. 

Differences  in  variation  between  the  high  and  low  energy  material,  are  due  to  differences  in  the 
characteristic  curves  for  these  materials.  As  shown  in  Figures  10  and  1 1,  the  data  for  high 
energy  material,  when  fitted  with  an  averaged  curve,  has  a single  maximum  that  defines  the 
maximum  force.  The  curve  for  the  low  energy  material  has  a maximum  point,  but  this  value  is 
likely  to  vary  more  that  the  high  energy  curve  due  to  details  of  individual  fracture  events. 

Figures  12  and  13  display  the  raw  data  for  the  seven  machines  included  in  the  round  robin  for 
low  and  high  energy  materials,  respectively. 

The  plots  of  the  raw  data  do  not  indicate  any  inconsistencies  among  machines.  Table  7 lists 
deviations  of  machine  means  from  the  grand  mean  for  each  material  based  on  seven  machines. 
The  low-energy  grand  average  is  33.01  kN  and  the  high-energy  grand  average  is  24.06  kN. 
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The  critical  values  for  h and  k in  Table  8 are  based  on  p - 7 and  n = 10 . An  h consistency 
statistic  is  considered  to  be  significant  if  its  absolute  value  is  larger  than  2.05.  A k consistency 
statistic  is  considered  significant  if  it  is  larger  than  1.54.  Figures  14  and  15  display  the 
consistency  statistics  from  Table  8 in  graphical  form  along  with  the  critical  values. 

Table  8 displays  h and  k consistency  statistics  based  on  seven  machines  for  both  low  and  high 
energy  materials. 


Table  7.  Deviations  for  seven  machines. 


Machine 

Low 
energy 
deviatio 
n (kN) 

High 
energy 
deviatio 
n (kN) 

1 

0.14 

-0.73 

2 

3.46 

0.97 

3 

1.55 

-0.43 

5 

-0.99 

0.81 

6 

-1.29 

0.00 

7 

-2.77 

-0.98 

8 

-0.09 

0.36 

Table  8.  Consistency  statistics  based  on  seven  machines. 


Machine 

Low  energy 

High  energy 

h 

k 

h 

K 

1 

0.06905 

0.24805 

-0.972 

0.34371 

2 

1.70392 

1.75492 

1.29185 

0.70227 

3 

0.76133 

1.45886 

-0.56638 

0.79529 

5 

-0.48921 

0.41158 

1.07358 

1.34943 

6 

-0.63703 

0.90646 

-0.00444 

1.77614 

7 

-1.36577 

0.29151 

-1.29861 

0.60673 

8 

-0.0423 

0.80896 

0.47601 

0.64223 
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k 


Machine  Number 

Figure  8.  Within-laboratory  consistency  k statistics  for  eight  Charpy  machines.  The  dashed  blue  lines 
(left)  correspond  to  the  low  energy  data  and  the  solid  red  lines  (right)  represent  high  energy  data, 
h 


Machine  Number 

Figure  9.  Between-laboratory  consistency  h statistics  for  eight  Charpy  machines.  The  dashed  blue  lines 
(left)  correspond  to  the  low  energy  data  and  the  solid  red  lines  (right)  represent  high  energy  data. 
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Load  vs.  Displacement 


Load  (N) 


Velocity  (m/s) 


Displacement  (mm) 

Figure  10.  Low  energy  curve  showing  maximum  force  (peak  load). 


Load  (N)  Load  vs.  Displacement  Veiociiy  (m/sj 


Figure  11.  High  energy  curve  showing  maximum  force  at  the  maxima  of  the  fitted  curve  (peak  load). 
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Maximum  Force  (kN)  Maximum  Force  (kN) 


Figure  12.  Maximum  force  for  seven  Charpy  machines  at  the  low  energy  level. 


Figure  13.  Maximum  force  for  seven  Charpy  machines  at  the  high  energy  level. 
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Machine  Number 

Figure  14.  Within-laboratory  consistency  k statistics  for  seven  Charpy  machines.  The  dashed  blue  lines 
(left)  correspond  to  the  low  energy  data  and  the  solid  red  lines  (right)  represent  high  energy  data, 
h 


Machine  Number 

Figure  15.  Between-laboratory  consistency  h statistics  for  seven  Charpy  machines.  The  dashed  blue  lines 
(left)  correspond  to  the  low  energy  data  and  the  solid  red  lines  (right)  represent  high  energy  data. 
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Table  9.  Precision  statistics  based  on  seven  machines. 


ID 

Grand 

mean 

(kN) 

Repeatability 

standard 

deviation, 

95% 

repeatability 

limit, 

Reproducibility 

standard 

deviation, 

95  % 

reproducibility 

limit, 

Sr(kN) 

r (kN) 

SR  (kN) 

R (kN) 

HH-108 

24.06 

0.16 

0.45 

0.77 

2.16 

LL-  108 

33.01 

0.68 

1.90 

2.13 

5.96 

The  data  in  Figures  14  and  15  do  not  indicate  that  any  machines  should  be  removed  from  the 
interlaboratory  comparison.  Significant  k statistics  for  machines  #3  and  #6  are  observed  for  only 
one  material,  and  there  are  no  significant  h statistics. 

Since  the  data  from  seven  machines  are  consistent,  the  precision  statistics  for  each  material  can 
be  computed.  Table  9 lists  the  grand  mean,  repeatability  standard  deviation,  reproducibility 
standard  deviation,  the  95  % repeatability  limit  (2.85',.)  and  the  95  % reproducibility  limit 
(2.85,). 

The  grand  mean  is  the  unweighted  average  of  the  individual  machine  means  and  is  not  the  same 
as  the  certified  reference  value  (which  is  a weighted  mean)  discussed  earlier. 

4.2.  Forces  at  General  Yield 

Forces  at  general  yield  (Fgy)  for  high-energy  specimens  (no  results  are  presented  for  low-energy 
specimens,  as  previously  explained)  are  displayed  in  Figure  16.  No  results  were  provided  for 
machine  #4. 

The  data  appear  to  be  fairly  consistent  among  machines  with  the  exception  of  machine  #6,  which 
provides  test  results  much  lower  than  the  rest  of  the  data.  Data  from  machine  #6  are  therefore 
excluded  from  further  analyses. 

4.2.1.  Striker  Radius 

Figure  17  displays  data  for  general  yield  forces  versus  striker  radius. 

In  order  to  establish  whether  striker  radius  has  an  effect  on  force  at  general  yield  for  the 
high-energy  specimens,  we  performed  a /-test  to  determine  if  the  mean  of  the  data  from  machines 
with  8 mm  striker  is  statistically  different  from  the  mean  of  data  from  machines  with  2 mm 
strikers  for  each  energy  level.  Based  on  the  /-test  (one  tailed  distribution,  two-sample  unequal 
variance),  the  8 mm  striker  mean  is  statistically  different  from  the  2 mm  striker  (p  < 0.0001). 
Figure  18  displays  the  means  of  each  group  along  with  error  bars  (twice  the  standard  error  of  the 
mean,  or  2s/Vn). 

The  error  bars  in  Figure  18  do  not  overlap,  also  indicating  that  there  is  a significant  difference 
between  2 mm  and  8 mm  striker  means. 
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x Striker  radius  2 mm  o Striker  radius  8 mm 
Figure  16.  High-energy  force  at  general  yield  Fgy  for  seven  machines. 
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Figure  17.  General  yield  force  Fgy  versus  striker  radius  for  high-energy  specimens. 
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Figure  18.  Fgy  means  and  associated  error  bars  (twice  the  standard  error  of  the  mean)  for  high-energy 
striker  means. 


4.2.2.  Repeatability  and  Reproducibility 

The  precision  of  general  yield  force  measurements  is  evaluated  according  to  the  terms  of 
repeatability  and  reproducibility  defined  in  ASTM  E691-05. 

For  reasons  already  explained,  the  second  set  of  NIST  measurements  was  not  included  in  the 
analysis.  Moreover,  the  fact  that  machine  #3  has  only  9 measurements  instead  of  1 0,  like  all 
remaining  machines,  is  considered  to  have  negligible  influence  on  the  results  of  the  analysis.  The 
raw  data  for  the  seven  machines  are  displayed  in  Figure  16. 

The  plot  of  the  raw  data  indicate  that  the  measurements  for  machine  #6  are  not  consistent  with 
the  remaining  data,  most  likely  due  to  an  incorrect  interpretation  of  the  instrumented  curves. 
Table  10  lists  summary  statistics  for  each  machine  (including  machine  #6)  and  material.  The 
low-energy  grand  mean  is  28.71  kN  and  the  high-energy  grand  mean  is  18.48  kN. 

Consistency  statistics  for  each  machine  are  listed  in  Table  11. 
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Table  10.  Machine  summary  statistics. 


Machine 

High  energy  (HH-103) 

Mean 

(kN) 

Standard 

deviation 

(kN) 

Deviation 

(kN) 

1 

17.68 

0.11 

-0.80 

2 

19.97 

0.26 

1.49 

3 

19.16 

1.69 

0.69 

5 

20.15 

0.51 

1.67 

6 

12.58 

0.35 

-5.90 

7 

19.32 

0.88 

0.84 

8 

20.55 

0.28 

2.07 

Table  11.  Consistency  statistics  for  seven  Charpy  machines. 


Machine 

High  Energy  (HH-103) 

h 

k 

1 

-0.28914 

0.03817 

2 

0.53897 

0.09479 

3 

0.24807 

0.60973 

5 

0.60439 

0.18529 

6 

-2.13188 

0.12614 

7 

0.30543 

0.31760 

8 

0.74898 

0.09975 

The  critical  values  for  h and  k were  taken  from  Table  5 in  E 691-05  for  p = 7 and  n-  10.  An  h 
consistency  statistics  is  considered  significant  if  its  absolute  value  is  larger  than  2.05.  A k 
consistency  statistic  is  considered  significant  if  it  is  larger  than  1.54.  Plots  of  the  consistency 
statistics  and  the  associated  critical  values  are  shown  in  Figures  19  and  20. 
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Figure  19.  Within-laboratory  consistency  k statistics  for  seven  Charpy  machines. 
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Figure  20.  Between-laboratory  consistency  h statistics  for  seven  Charpy  machines. 
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Since  none  of  the  machines  has  a significant  k value,  there  is  no  reason  to  remove  any  of  them 
from  the  study  based  on  k statistics. 

The  h consistency  statistics  are  significant  for  machine  #6,  indicating  that  the  measurements  for 
this  machine  are  significantly  different  from  those  of  the  remaining  machines  relative  to  the 
between-machine  variation.  We  will  remove  machine  #6  from  the  study  since  the  measurements 
were  significantly  lower  than  the  rest  of  the  measurements. 

Figure  21  displays  the  raw  data  for  the  six  machines  included  in  the  round-robin  analyses. 

The  plot  of  the  raw  data  do  not  indicate  significant  inconsistencies  among  machines.  Table  12 
lists  deviations  of  machine  means  from  the  grand  mean  for  each  material  based  on  six  machines. 
The  high-energy  grand  mean  is  19.60  kN. 


Figure  21.  Force  at  general  yield  Fgy  for  six  Charpy  machines  at  the  high  energy  level. 
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Table  12.  Deviations  for  six  machines. 


Machine 

High 

energy 

deviation 

(kN) 

1 

-1.92 

2 

0.37 

3 

-0.44 

5 

0.55 

7 

-0.28 

8 

0.95 

Machine  number 

Figure  22.  Within-laboratory  consistency  statistics  for  six  Charpy  machines. 
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Figure  23.  Between-laboratory  consistency  h statistics  for  six  Charpy  machines. 
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Table  13.  Consistency  statistics  based  on  six  machines. 


Machine 

High  energy 

h 

k 

1 

0.10351 

0.12875 

2 

0.25704 

0.31972 

3 

1.65342 

2.05664 

5 

0.50246 

0.62500 

7 

0.86123 

1.07126 

8 

0.27050 

0.33646 

Table  13  displays  h and  k consistency  statistics  based  on  six  machines. 

The  critical  values  for  h and  k in  Table  13  are  based  onp  = 6 and  n = 10.  An  h consistency 
statistic  is  considered  to  be  significant  if  it  is  larger  than  1.92.  A k consistency  statistic  is 
considered  to  be  significant  if  it  is  larger  than  1.52.  Figures  22  and  23  display  the  consistency 
statistics  from  Table  13  in  graphical  form  along  with  the  critical  values. 

The  data  in  Figure  22  and  23  do  not  indicate  that  any  machines  should  be  removed  from  the 
interlaboratory  comparison.  A significant  k statistics  is  observed  only  for  machine  #3,  and  there 
are  no  significant  h statistics. 
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Since  the  general  yield  data  from  six  machines  is  consistent,  the  precision  statistics  can  be 
computed  for  the  high-energy  material.  Table  14  lists  the  grand  mean,  repeatability  standard 
deviation,  reproducibility  standard  deviation,  the  95  % repeatability  limit  ( 2.8Sr ) and  the  95  % 
reproducibility  limit  ( 2.8SR ). 


Table  14.  Precision  statistics  based  on  six  machines. 


ID 

Grand 

mean 

(kN) 

Repeatability 

standard 

deviation, 

Sr(kN) 

95  % 

repeatability 
limit, 
r (kN) 

reproducibility 

standard 

deviation, 

Sr  (kN) 

95% 

reproducibility 
limit, 
r (kN) 

HH-103 

19.60 

0.82 

2.30 

1.28 

3.59 
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Appendix  A.  Raw  Data  from  Force  Verification  Round  Robin 


Machine 

Test 

Number 

Fm  (kN) 
Low 
Energy 

Fm  (kN) 
High 
Energy 

Fgy  (kN) 
High 
Energy 

Machine 

Test 

Number 

Fm  (kN) 
Low 
Energy 

Fm (kN) 
High 
Energy 

Fgy  (kN) 
High 
Energy 

1 

1 

33.12 

23.39 

17.58 

5 

6 

31.90 

25.10 

20.10 

1 

2 

33.14 

23.44 

17.71 

5 

7 

32.60 

24.90 

20.30 

1 

3 

33.03 

23.32 

17.74 

5 

8 

32.20 

25.10 

20.30 

1 

4 

33.06 

23.31 

17.50 

5 

9 

31.90 

24.70 

21.00 

1 

5 

33.31 

23.38 

17.78 

5 

10 

31.70 

24.90 

20.80 

1 

6 

33.07 

23.24 

17.77 

6 

1 

31.90 

24.30 

13.00 

1 

7 

32.89 

23.30 

17.73 

6 

2 

31.80 

24.50 

13.00 

1 

8 

33.11 

23.32 

17.66 

6 

3 

32.80 

24.50 

12.80 

1 

9 

33.36 

23.30 

17.53 

6 

4 

31.40 

24.10 

12.50 

1 

10 

33.44 

23.33 

17.78 

6 

5 

32.10 

23.90 

12.20 

2 

1 

36.65 

25.06 

20.02 

6 

6 

31.20 

23.80 

12.80 

2 

2 

37.58 

25.16 

19.90 

6 

7 

30.70 

23.70 

12.30 

2 

3 

37.00 

24.93 

19.89 

6 

8 

32.30 

23.90 

12.00 

2 

4 

38.32 

24.90 

19.92 

6 

9 

31.80 

23.80 

12.40 

2 

5 

35.72 

24.96 

20.25 

6 

10 

31.20 

24.10 

12.80 

2 

6 

37.17 

24.96 

20.02 

7 

1 

30.42 

23.30 

18.69 

2 

7 

35.89 

25.07 

19.54 

7 

2 

30.24 

23.10 

18.95 

2 

8 

34.00 

25.00 

19.63 

7 

3 

30.09 

23.02 

19.00 

2 

9 

36.05 

25.02 

20.11 

7 

4 

30.40 

23.11 

20.95 

2 

10 

36.33 

25.28 

20.42 

7 

5 

30.25 

23.03 

19.60 

3 

1 

34.90 

23.60 

18.73 

7 

6 

30.57 

22.94 

18.39 

3 

2 

34.81 

23.52 

18.47 

7 

7 

30.07 

23.06 

19.02 

3 

3 

34.96 

23.68 

18.72 

7 

8 

30.25 

23.19 

18.98 

3 

4 

34.21 

23.68 

18.80 

7 

9 

30.25 

23.10 

20.83 

3 

5 

33.60 

23.91 

18.82 

7 

10 

29.88 

23.06 

18.83 

3 

6 

33.42 

23.46 

18.43 

8a 

1 

33.35 

24.40 

20.68 

3 

7 

35.30 

23.64 

18.81 

8a 

2 

33.14 

24.43 

20.85 

3 

8 

35.01 

23.70 

18.49 

8a 

3 

32.69 

24.47 

21.07 

3 

9 

33.06 

23.55 

18.78 

8a 

4 

33.40 

24.44 

20.75 

3 

10 

36.31 

18.73 

8a 

5 

33.23 

24.50 

20.24 

4 

1 

22.90 

18.50 

8a 

6 

32.26 

24.48 

20.39 

4 

2 

22.70 

18.30 

8a 

7 

33.53 

24.15 

20.41 

4 

3 

22.70 

18.50 

8a 

8 

33.20 

24.50 

20.45 

4 

4 

23.20 

18.60 

8a 

9 

32.59 

24.48 

20.23 

4 

5 

22.70 

18.60 

8a 

10 

31.88 

24.36 

20.43 

4 

6 

23.00 

18.60 

8b 

1 

32.54 

24.23 

20.23 

4 

7 

22.70 

18.60 

8b 

2 

33.84 

24.51 

20.23 

4 

8 

23.00 

18.80 

: 8b 

3 

32.82 

24.52 

20.56 

4 

9 

23.20 

18.70 

' 8b 

4 

32.79 

24.41 

20.29 

4 

10 

22.90 

18.80 

8b 

5 

33.64 

24.51 

20.18 

5 

1 

31.70 

24.40 

19.90 

8b 

6 

31.75 

24.36 

20.45 

5 

2 

31.90 

24.90 

19.70 

8b 

7 

33.45 

24.40 

20.38 

5 

3 

32.20 

24.70 

19.20 

8b 

8 

33.79 

24.56 

20.65 

5 

4 

31.90 

25.10 

20.10 

8b 

9 

32.26 

24.55 

20.55 

5 

5 

32.20 

24.90 

20.10 

8b 

10 

j 33.79 

24.44 

20.57 
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